Systems and methods for compensating for visual distortion caused by surface features on a display

ABSTRACT

Systems and methods for compensating for visual distortion caused by surface features on a display are disclosed. For example, one disclosed system includes: a display including one or more surface features; a processor configured to: receive a display signal including graphical data; determine a location of the surface feature; transform the display signal based at least in part on the location of the surface feature; and cause the transformed display signal to be displayed.

CROSS REFERENCE TO RELATED APPLICATIONS

This Application is a continuation of and claims priority to applicationSer. No. 12/608,875, filed on Oct. 29, 2009, and entitled “Systems andMethods for Compensating for Visual Distortion Caused by SurfaceFeatures on a Display,” the entirety of which is hereby incorporatedherein by reference.

FIELD OF THE INVENTION

The present invention generally relates to display systems, and moreparticularly to systems and methods for compensating for visualdistortion caused by surface features on a display.

BACKGROUND

The use of touch-screens in all types of devices is becoming morecommon. Conventional touch-screens have a flat surface. But manytouch-screens can benefit from the tactile haptic feedback caused by theaddition of surface features. These surface features can lead todistortion of the image on the display. Thus, there is a need forsystems and methods for compensating for visual distortion caused bysurface features on a display.

SUMMARY

Embodiments of the present invention provide systems and methods forcompensating for visual distortion caused by surface features on adisplay. For example, one embodiment discloses a system comprising: adisplay comprising one or more surface features; a processor configuredto: receive a display signal comprising graphical data; determine alocation of the surface feature; transform the display signal based atleast in part on the location of the surface feature; and cause thetransformed display signal to be displayed.

These illustrative embodiments are mentioned not to limit or define theinvention, but to provide examples to aid understanding thereof.Illustrative embodiments are discussed in the Detailed Description, andfurther description of the invention is provided there. Advantagesoffered by various embodiments of this invention may be furtherunderstood by examining this specification.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other features, aspects, and advantages of the presentinvention are better understood when the following Detailed Descriptionis read with reference to the accompanying figures, wherein:

FIG. 1 is a block diagram of a system for compensating for visualdistortion caused by surface features on display according to oneembodiment of the present invention;

FIG. 2 is an illustrative embodiment of a system for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention;

FIGS. 3 a and 3 b are cross-section illustrations of a system forcompensating for visual distortion caused by surface features on adisplay according to one embodiment of the present invention;

FIG. 4 is a flow diagram illustrating a method for determining thelocation of surface features on a display according to one embodiment ofthe present invention;

FIG. 5 is a flow diagram illustrating a method for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention; and

FIGS. 6 a and 6 b are illustrations of a system for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention.

DETAILED DESCRIPTION

Embodiments of the present invention provide systems and methods forcompensating for visual distortion caused by surface features on adisplay.

Illustrative Embodiment of Compensating for Distortion Caused by SurfaceFeatures on a Display

One illustrative embodiment of the present invention comprises a mobiledevice such as a mobile phone. The mobile device comprises a housing,which contains a touch-screen display. The mobile device also comprisesa processor and memory. The processor is in communication with both thememory and the touch-screen display. To provide active haptic feedback,the illustrative mobile device comprises an actuator, which is incommunication with the processor. The actuator is configured to receivea haptic signal from the processor, and in response, output a hapticeffect. In the illustrative embodiment, as the user interacts with themobile device, the processor generates the appropriate haptic signal andtransmits the signal to the actuator. The actuator then produces theappropriate haptic effect.

In the illustrative embodiment, the touch-screen display is configuredto receive signals from the processor and display a graphical userinterface. The touch-screen of the illustrative device also comprisessurface features, which provide tactile feedback. In one embodiment, thetouch-screen may comprise permanent or static surface features, forexample, grooves cut into the surface of the touch screen. In otherembodiments the user may place a removable skin comprising staticsurface features over the surface of the touch-screen. In still otherembodiments, the user may have dropped the mobile device, leading tosurface features in the form of scratches. In still other embodiments,the display may be made out of a deformable or “smart” material that canchange surface features according to the function of the device or theneeds of the user.

In the illustrative embodiment, static surface features are formed byraised or lowered sections of the touch-screen. These raised or loweredsections form ridges and troughs, which the user will feel wheninteracting with the touch-screen. In some embodiments, these ridges andtroughs may form a pattern that the user recognizes. For example, in theillustrative device, the touch-screen comprises surface features thatform the letters and numbers of a QWERTY keyboard. In some embodiments,the graphical user interface displayed by the touch-screen comprises akeyboard corresponding to the surface features on the surface of thetouch-screen. For example, the surface features on a touch-screendisplay may form a QWERTY keyboard, while a corresponding virtual QWERTYkeyboard is shown on the display. In other embodiments, the image shownon the display does not correspond to the surface features. For example,the surface features may form a QWERTY keyboard, while the display showsa user defined background image. In some embodiments these troughs andridges are permanently applied to the surface of the touch-screen. Inother embodiments, a skin comprising the surface features is placedovertop of the touch-screen.

In the illustrative embodiment, the touch-screen may further comprisedynamic surface features. In such an embodiment, a processor controlsthe shape, depth, height, or other characteristics of the dynamicsurface features. In some embodiments, dynamic surface features may beimplemented by a haptic substrate placed underneath a flexible display.In such an embodiment the haptic substrate may flex upward or downward,forming dynamic ridges or troughs in the surface of the flexibledisplay.

The surface features may distort the image output by the display. Thus,there is a need for systems and methods for compensating for visualdistortion caused by surface features on a display. In the illustrativeembodiment, the processor determines a location of the surface features.For example, the processor may receive a sensor signal from a sensorconfigured to detect the location of the surface features. In anotherembodiment, the processor may access a data store to determine thelocation of surface features. In another embodiment, the processor maycontrol dynamic surface features, and thus have already stored thecoordinates of the surface features. The processor also receives adisplay signal, and transforms the display signal based at least in parton the location of the surface features. For example, the processor maytransform the display signal by modifying the brightness, hue, contrast,resolution, saturation, sharpness, or image warping of the signal. Theprocessor may transform the entire display signal, or transform only theportions of the display signal that correspond to the locations of thesurface features. Finally, the processor causes the transformed displaysignal to be displayed. The transformation compensates for thedistortion caused by the surface features. Thus, when the transformeddisplay signal is output, the distortion is less visible to the user.

This illustrative example is given to introduce the reader to thegeneral subject matter discussed herein. The invention is not limited tothis example. The following sections describe various additionalembodiments and examples of methods and systems for compensating for thedistortion caused by surface features on a display.

Illustrative Systems for Compensating for Distortion Caused by SurfaceFeatures on a Display

Referring now to the drawings in which like numerals indicate likeelements throughout the several Figures, FIG. 1 is a block diagram of asystem for compensating for visual distortion caused by surface featureson a display according to one embodiment of the present invention. Asshown in FIG. 1, the system 100 comprises a mobile device 102, such as amobile phone, portable digital assistant (PDA), portable media player,or portable gaming device. The mobile device 102 comprises a processor110. The processor 110 includes or is in communication with one or morecomputer-readable media, such as memory 112, which may comprise randomaccess memory (RAM). Processor 110 is also in communication with anetwork interface 114, a display 116 comprising surface features 117, anactuator 118, and a speaker 120. The processor 110 is configured togenerate a graphical user interface, which is displayed to the user viadisplay 116.

Embodiments of the present invention can be implemented in combinationwith, or may comprise combinations of, digital electronic circuitry,computer hardware, firmware, and software. The mobile device 102 shownin FIG. 1 comprises a processor 110, which receives input signals andgenerates signals for communication, display, and providing hapticfeedback. The processor 110 also includes or is in communication withone or more computer-readable media, such as memory 112, which maycomprise random access memory (RAM).

The processor 110 is configured to execute computer-executable programinstructions stored in memory 112. For example, processor 110 mayexecute one or more computer programs for messaging or for generatinghaptic feedback. Processor 110 may comprise a microprocessor, a digitalsignal processor (DSP), an application-specific integrated circuit(ASIC), one or more field programmable gate arrays (FPGAs), or statemachines. Processor 110 may further comprise a programmable electronicdevice such as a programmable logic controller (PLC), a programmableinterrupt controller (PIC), a programmable logic device (PLD), aprogrammable read-only memory (PROM), an electronically programmableread-only memory (EPROM or EEPROM), or other similar devices.

Memory 112 comprises a computer-readable media that stores instructions,which when executed by processor 110, cause processor 110 to performvarious steps, such as those described herein. Embodiments ofcomputer-readable media may comprise, but are not limited to, anelectronic, optical, magnetic, or other storage or transmission devicescapable of providing processor 110 with computer-readable instructions.Other examples of media comprise, but are not limited to, a floppy disk,CD-ROM, magnetic disk, memory chip, ROM, RAM, ASIC, configuredprocessor, all optical media, all magnetic tape or other magnetic media,or any other medium from which a computer processor can read. Inaddition, various other devices may include computer-readable media suchas a router, private or public network, or other transmission devices.The processor 110 and the processing described may be in one or morestructures, and may be dispersed throughout one or more structures.

Processor 110 is in communication with a network interface 114. Networkinterface 114 may comprise one or more methods of mobile communication,such as infrared, radio, Wi-Fi or cellular network communication. Inother variations, network interface 114 comprises a wired networkinterface, such as Ethernet. The mobile device 102 is configured toexchange data with other devices (not shown in FIG. 1) over networkssuch as a cellular network and/or the Internet. Embodiments of dataexchanged between devices may comprise voice messages, text messages,data messages, or other forms of messages.

In the embodiment shown in FIG. 1, the processor 110 is also incommunication with display 116. Display 116 is configured to displayoutput from the processor 110 to the user. In some embodiments,processor 110 is configured to generate a signal, which is associatedwith a graphical representation of a user interface shown on display116. Display 116 may comprise many different types of components. Forexample, in one embodiment, mobile device 102 comprises a liquid crystaldisplay (LCD). In some embodiments, display 116 comprises atouch-screen. In some embodiments, the display and the touch-screencomprise a single, integrated component such as a touch-screen LCD.

In some embodiments, display 116 further comprises a touch-screenconfigured to detect a user interaction and transmit signalscorresponding to that user interaction to processor 110. Processor 110then uses the received signals to modify the graphical user interfacedisplayed on display 116. Thus, a user may interact with virtual objectson display 116. For example, display 116 may comprise a virtualkeyboard. When the user interacts with the keys of the virtual keyboard,the touch-screen transmits signals corresponding to that interaction toprocessor 110. Based on these signals, processor 110 may determine thatthe user depressed certain keys on the virtual keyboard. As one example,a user may use this functionality to enter a text message or other textdocument. In other embodiments, the touch-screen may enable the user tointeract with other virtual objects such as stereo controls, mapfunctions, virtual message objects, or other types of graphical userinterfaces. Thus, a touch-screen in combination with display 116 givesusers the ability to interact directly with the contents of thegraphical user interface.

In some embodiments, not shown in FIG. 1, the display may comprise areflective surface. In such an embodiment, the processor 110 iscommunicatively connected to a projector, which projects an image ontothe display. In such an embodiment, the reflective surface may comprise,for example, a projector screen, a floor, a wall, a sporting field, or ahuman body. In such an embodiment, the reflective surface furthercomprises surface features. For example, a projector screen may comprisea surface feature in the form of a fold. In another example, a brickwall may comprise surface features formed by seams between the bricks.In other embodiments, the reflective surface may be a building, a desk,a table surface or some other reflective surface.

Display 116 comprises surface features 117 covering at least a portionof its surface. Surface features 117 are formed by raising or loweringsections of the surface of display 116. These raised or lowered portionsform ridges and troughs that the user feels when interacting withdisplay 116. The ridges and troughs may form shapes that the userrecognizes. For example, in one embodiment, the surface features maytake the form of letters and numbers arranged in a QWERTY keyboardconfiguration. In other embodiments, the surface features may form othershapes, for example, a grid or a swirl.

In some embodiments, surface features 117 may be permanently applied tothe surface of display 116. In other embodiments, the user applies aremovable skin to the surface of display 116, the removable skincomprising surface features 117. In such an embodiment, the user mayremove the skin and replace it with a different skin comprisingdifferent surface features. Thus, the user may apply different surfacefeatures for different applications. Mobile device 102 may furthercomprise a data store, which comprises data regarding the location ofsurface features 117 on display 116. In some embodiments, the data storeis a portion of memory 122. Processor 110 may use the information in thedata store to modify the graphical user interface displayed on display116. For example, processor 110 may display a virtual keyboardcorresponding to a skin comprising surface features in the form of akeyboard.

When the user applies a new skin with different surface features 117,the user may update the data store to reflect the change in the surfacefeatures 117. In one embodiment, the user may update the data storemanually using one the inputs of mobile device 102. In otherembodiments, processor 110 may use network interface 114 to downloadinformation about the surface features. In still other embodiments,mobile device 102 may comprise a sensor, which detects when the userapplies a new skin to the surface of touch-screen display 116. In suchan embodiment, the skin comprises a unique identifier that matches itssurface features. For example, a skin may comprise surface features inthe form of a QWERTY keyboard, and further comprise a unique identifiercorresponding to a QWERTY keyboard. When the user places the skin overthe surface of touch-screen display 116, a sensor detects the uniqueidentifier, and transmits a signal corresponding to that uniqueidentifier to processor 110. The unique identifier may be for example, amagnetic identifier, a bar code, an RFID tag, or another sensor readableidentifier. In other embodiments, the unique identifier may be a number,which the user reads and then manually enters into the mobile device.

Once processor 110 receives a signal corresponding to the skin's uniqueidentifier, processor 110 may access the data store to determine alocation of the surface feature on the display. For example, whenprocessor 110 receives an indication that the user placed a skincomprising surface features in the form of a QWERTY keyboard overdisplay 116, processor 110 may access the data store to determine thelocation of the surface features. In other embodiments, processor 110may receive a signal from a sensor configured to detect the location ofthe surface features on the surface of the display. For example,processor 110 may be communicatively connected to a camera or otheroptical sensor, which captures an image of the display and transmits acorresponding signal to processor 110. Based on this signal, processor110 may determine the location of surface features 117 on display 116.

In another embodiment, the display 116 may comprise dynamic surfacefeatures. In such an embodiment, processor 110 controls the operation ofa haptic substrate mounted underneath the surface of display 116. Insuch an embodiment, display 116 is made of a flexible material, and inresponse to signals received from processor 110, the haptic substrateflexes, forming ridges, troughs, or other features on the surface ofdisplay 116. In some embodiments, the haptic substrate may comprise aplasma actuator, a piezoelectric actuator, an electro-active polymer, aMicro-Electro-Mechanical System, a shape memory alloy, a grid of fluidor gas-filled cells. Additional embodiments and applications for hapticsubstrates that implement dynamic surface features are discussed in U.S.patent application Ser. No. 12/353,516, filed Oct. 17, 2008, U.S. patentapplication Ser. No. 11/943,862, filed Nov. 21, 2007, and U.S. PatentApplication No. 61/176,431, filed May 7, 2009, the entirety of all ofwhich is hereby incorporated by reference.

Processor 110 is configured to receive a display signal comprisinggraphical data. In some embodiments, the graphical data may comprise auser interface. In some embodiments the graphical data may correspond tothe surface features 117. In other embodiments, the graphical data maycorrespond to an image unrelated to the surface features.

Processor 110 is further configured to transform the display signal,based at least in part on the location of surface features 117. Forexample, in one embodiment processor 110 may transform the displaysignal to modify brightness, hue, contrast, resolution, saturation,sharpness or image warping. In other embodiments, processor 110 maystretch, compress, or otherwise modify the image itself. In someembodiments, processor 110 may transform the entire display signal. Inother embodiments, processor 110 may transform only the portion of thedisplay signal that corresponds to the location of the surface features.For example, in one embodiment, the display signal may comprise datathat corresponds to an image of a flower. In such an embodiment, display116 may comprise a skin comprising surface features in the form of aQWERTY keyboard. In such an embodiment, the processor may transform thedisplay signal to adjust the brightness, hue, contrast, saturation,sharpness, or image warping of the portions of the display signal thatwill be obstructed by the QWERTY keyboard. This transformation may serveto minimize the distortion caused by the surface features 117.

In some embodiments, the mobile device 102 may comprise a sensor (notshown in FIG. 1) configured to detect the user's viewing angle. Thissensor may transmit a signal comprising a measurement of the user'sviewing angle to processor 110. Based at least in part on this signal,processor 110 may further transform the video signal to reducedistortion caused by the user's viewing angle. This distortion may bethe result of convex or concave portions of the display magnifying orotherwise altering the user's view of the display. In some embodiments,for example, the additional sensor may comprise an eye tracking sensor.In such an embodiment, the eye-tracking sensor may transmit a signal tothe processor 110 indicating that the user's view of the display istilted at a 45-degree angle. Based at least on part on this signal,processor 110 may transform the video signal to compensate foradditional distortion caused by the user's viewing angle. In otherembodiments, the sensor may comprise cameras, infrared, ultrasoundsensors, gyroscopes, or accelerometers configured to track the directionthat the user's head is facing relative to the display. In suchembodiments, the processor may use the derived viewing angle to furthercompensate for visual distortion.

In some embodiments, upon receipt of the unique identifier, processor110 may determine to output a user interface that corresponds to thesurface features 117. For example, in one embodiment, a user may apply askin comprising surface features that form a QWERTY keyboard, for usewhen entering a text message. In another embodiment, the user may applya skin comprising surface features in the form of stereo controls foruse with a music player application. In another embodiment, the user mayapply a skin comprising surface features in the form of numbers andmathematical symbols for use with the mobile device's calculatorfunction. In an embodiment wherein the mobile device includes thecapability of generating dynamic surface features, when processor 110transmits a signal to change the image on display 116, processor 110 mayalso transmit a signal to a haptic substrate. In response, the hapticsubstrate may generate dynamic surface features on the display surfacethat correspond to the displayed image. For example, if display 116comprises an image of a calculator, the dynamic surface features maytake the shape of a numeric keypad. In another example, if display 116comprises a virtual QWERTY keyboard, the dynamic surface features maytake the shape of a virtual QWERTY keyboard.

In some embodiments, mobile device 102 may comprise a mode of input,such as a track ball, buttons, keys, a scroll wheel, and/or a joystick(not shown in FIG. 1). These additional forms of input may be used tointeract with the graphical user interface displayed on display 116.

As shown in FIG. 1, processor 110 is also in communication with one ormore actuators 118. Processor 110 is configured to determine a hapticeffect, and transmit a corresponding haptic signal to actuator 118.Actuator 118 is configured to receive the haptic signal from theprocessor 110 and generate a haptic effect. Actuator 118 may be, forexample, a piezoelectric actuator, an electric motor, anelectro-magnetic actuator, a voice coil, a linear resonant actuator, ashape memory alloy, an electro-active polymer, a solenoid, an eccentricrotating mass motor (ERM), or a linear resonant actuator (LRA).

FIG. 2 is an illustrative embodiment of a system for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention. The elements of system 200 aredescribed with reference to the system depicted in FIG. 1, but a varietyof other implementations are possible.

As shown in FIG. 2, system 200 comprises a mobile device 102, such as amobile phone, portable digital assistant (PDA), portable media player,or portable gaming device. Mobile device 102 may include a wirelessnetwork interface and/or a wired network interface 114 (not shown inFIG. 2). Mobile device 102 may use this network interface to send andreceive signals comprising voice-mail, text messages, and other datamessages over a network such as a cellular network, intranet, or theInternet. Although FIG. 2 illustrates device 102 as a handheld mobiledevice, other embodiments may use other devices, such as video gamesystems and/or personal computers.

As shown in FIG. 2, mobile device 102 comprises a touch-screen display216. In addition to touch-screen display 216, the mobile device 102 maycomprise buttons, a touchpad, a scroll wheel, a rocker switch, ajoystick, or other forms of input (not shown in FIG. 2). Touch-screendisplay 216 is configured to receive signals from the processor 110 andoutput an image based upon those signals. In some embodiments, the imagedisplayed by touch-screen display 216 comprises a graphical userinterface.

Touch-screen display 216 is further configured to detect userinteraction and transmit signals corresponding to that interaction toprocessor 110. Processor 110 may then manipulate the image displayed ontouch-screen display 216 in a way that corresponds to the userinteraction. Thus, a user may interact with virtual objects displayed ontouch-screen display 216. For example, touch-screen display 216 maycomprise a virtual keyboard. Then, when the user interacts with the keysof the virtual keyboard, touch-screen display 216 transmits signalscorresponding to that interaction to processor 110. Based on thissignal, processor 110 will determine that the user depressed certainkeys on the virtual keyboard. A user may use such an embodiment, forexample, to enter a text message or other text document. In otherembodiments, touch-screen display 216 may enable the user to interactwith other virtual objects such as stereo controls, map functions,virtual message objects, or other types of virtual user interfaces.

Touch-screen display 216 comprises surface features 117. These surfacefeatures are formed by raising or lowering sections of touch-screendisplay 216. These raised or lowered sections form troughs and ridgesthat the user can feel on the ordinarily flat surface of touch-screendisplay 216. In the embodiment shown in FIG. 2, surface features 117form a grid overlaying touch-screen display 216. In other embodiments,the surface features may form a QWERTY keyboard, stereo controls, thenumbers and symbols of a calculator, or some other pattern.

In some embodiments, the troughs and ridges may be formed at the timetouch-screen display 216 is manufactured. In such an embodiment, surfacefeatures 117 are permanent. In other embodiments, the user installs askin comprising troughs or ridges over the surface of touch-screendisplay 216. In such an embodiment, the user may change the surfacefeatures on touch-screen display 216 by changing the skin. Thus, theuser may have multiple skins comprising different surface features fordifferent applications. For example, a user may apply a skin comprisingsurface features that form a QWERTY keyboard for a text messagingapplication. Then, when the user wishes to use the mobile device as aportable music player, the user may apply a skin comprising surfacefeatures in the form of stereo controls. In some embodiments, thesurface features are the result of a haptic substrate that is controlledby processor 110 to generate dynamic surface features on display 216. Insuch an embodiment, processor 110 can control the surface features tocorrespond to the display signal. For example, in one embodiment,processor 110 may transmit a display signal that generates a graphicaluser interface comprising stereo controls on display 216. In such anembodiment, processor 110 may further transmit a signal to a hapticsubstrate that causes the haptic substrate to generate dynamic surfacefeatures on display 216.

FIGS. 3 a and 3 b are cross-section illustrations of a system forcompensating for visual distortion caused by surface features on adisplay according to one embodiment of the present invention. Theembodiments shown in FIGS. 3 a and 3 b comprise a cross section view ofa mobile device 300. Mobile device 300 comprises an LCD display 302.Resting on top of the LCD display 302 is a touch-screen 304. In otherembodiments, the LCD display 302 and touch-screen 304 may comprise asingle integrated component, such as a touch-screen LCD display.

The touch-screen 304 comprises an ordinarily flat surface 308. Surfacefeatures 306 cover at least a portion of touch-screen 304. In oneembodiment shown in FIG. 3 a, surface features are formed by troughs 306a and 306 b. In another embodiment shown in FIG. 3 b, the surfacefeatures are formed by ridges 306 c and 306 d. In other embodiments, thesurface features may include a combination of ridges and troughs (notshown). In still other embodiments, a curvature of the display itselfmay form the surface features.

When the user drags a finger across touch-screen 308, the surfacefeatures 306 provide the user with indications of their finger'slocation. In some embodiments, the surface features 306 may form lettersor numbers. These letters or numbers may be arranged in a QWERTYkeyboard configuration or in the configuration of a calculator. In otherembodiments, the surface features 306 may form a grid, web, or spiralconfiguration.

Illustrative Methods for Compensating for Distortion Caused by SurfaceFeatures on a Display

FIG. 4 is a flow diagram illustrating a method for determining thelocation of surface features on a display according to one embodiment ofthe present invention.

The method 400 begins when processor 110 receives an indication that askin comprising at least one surface feature 117 has been placed overthe surface of display 116, 402. In some embodiments, display 116further comprises a touch-screen and the processor 110 receives theindication from the touch-screen display 116. For example, thetouch-screen may detect the skin and transmit a corresponding signal toprocessor 110. In another embodiment, the user may enter the indicationvia the touch-screen. In other embodiments, the mobile device maycomprise another sensor, which detects that the user placed a skin overthe surface of display 116. This sensor may be, for example, one or moreof a bar code reader, a camera sensor, an RFID reader, anelectromagnetic reader, or some other sensor.

The surface features may form shapes, which the user may recognize. Forexample, in one embodiment, the surface features may take the form ofletters and numbers organized in a QWERTY keyboard configuration. Inother embodiments, the surface features may form a grid, swirl, or someother pattern. The user may remove and replace the skin with a new skincomprising different surface features. Thus, the user has the option ofplacing different surface features on the surface of display 116 fordifferent applications.

Next, processor 110 receives a signal corresponding to a uniqueidentifier associated with the skin 404. In some embodiments, the uniqueidentifier may be a number on the skin. In such an embodiment, the usermay manually enter the number via a touch-screen, which transmits asignal associated with the unique identifier to processor 110. In otherembodiments, the mobile device may comprise a sensor, which detects theunique identifier associated with the skin. For example, in oneembodiment the skin may comprise a bar code, an RFID, or a magnetic ID.In such an embodiment, the mobile device comprises a sensor, whichdetects the unique identifier and transmits a corresponding signal toprocessor 110. In other embodiments, display 116 may automaticallydetect the surface features on the skin, and transmit a correspondingsignal to processor 110. In other embodiments, the processor 110receives information identifying the type and location of surfacefeatures. For example, a user may enter the size and shape of a surfaceon which a display is to be projected, such as the diameter and heightof a column or the size of a wall and the layout of bricks on the wall.

The process continues when processor 110 receives a signal associatedwith the location of the surface feature 406. In some embodiments, theprocessor may receive the location from a data store. In such anembodiment, the data store may be a local data store associated withmemory 112. In other embodiments, the data store may be a remote datastore that is accessed via network interface 114. In such an embodiment,the processor 110 transmits a signal associated with the uniqueidentifier to the remote data store via network interface 114. Then, theremote data store transmits a signal associated with the surfacefeatures back to network interface 114, which transmits the signal toprocessor 110. In another embodiment, the mobile device may comprise ahaptic substrate configured to generate dynamic surface features ondisplay 116. In such an embodiment, processor 110 transmits a signal tothe haptic substrate, the signal configured to cause the hapticsubstrate to generate dynamic surface features at specific locations ondisplay 116. In such an embodiment, determining the location of thesurface features comprises using the same location as the location ofthe dynamic surface features generated by processor 110.

FIG. 5 is a flow diagram illustrating a method for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention.

The method 500 begins when processor 110 receives a display signalcomprising graphical data 502. In some embodiments, the graphical datamay comprise a plurality of pixels, that when combined, form an image.In some embodiments, the display signal may comprise a graphical userinterface. In other embodiments, the display signal may comprise a userdefined image.

Next, at 504, the processor 110 determines a location of a surfacefeature of a display 116. In some embodiments, a skin placed over thesurface of the display 116 may comprise the surface feature. In such anembodiment, the processor may determine the location of the surfacefeature using the method referenced in the discussion of FIG. 4.

In other embodiments, the surface feature may be permanently applied tothe surface of the display 116. For example, in some embodiments, thesurface feature may comprise a raised or grooved portion installedduring the manufacture of the display 116. In another example, apermanent surface feature may comprise a scratch on the surface of thedisplay 116, formed when the user dropped the device. In still otherembodiments, the display may comprise a reflective surface on which aprojector outputs an image. In such an embodiment, the reflectivesurface may comprise a surface which is ordinarily curved ornon-uniform. For example, such a surface may comprise a brick wall, afloor, a stairway, a sporting field, a building, a desk, a tablesurface, or a human body. In such embodiments, the processor 110 mayreceive a sensor signal from a sensor configured to detect the locationof surface features. For example, in one embodiment, the sensor maycomprise a camera or other optical sensor. In such an embodiment, thesensor may transmit a signal corresponding to the locations of surfacefeatures to processor 110. Based at least in part on this signal,processor 110 may determine the location of surface features on thedisplay. For example, in one embodiment the reflective surface maycomprise a bench on a sidewalk. In such an embodiment, an optical sensormay transmit a sensor signal to the processor 110. The sensor signal maycomprise data that the processor uses to determine the location ofsurface features on the bench. For example, the processor may determinethe location of bolts and posts. In some embodiments, the surfacefeatures may be dynamic. For example, in such an embodiment, theprocessor may transmit a signal to a haptic substrate configured togenerate a surface feature on the surface of the display. In such anembodiment, determining the location of the surface feature may compriseusing the same location as the processor used to generate the dynamicsurface feature. In some embodiment, the surface features may move onthe surface of the display. In such an embodiment, the processor may befurther configured to determine the location of the surface features asthey move.

Then, at 506, processor 110 transforms the display signal based at leastin part on the location of the surface features 117. For example, in oneembodiment, processor 110 may transform the display signal to modifybrightness, hue, contrast, saturation, sharpness, or image warping. Insome embodiments, processor 110 may transform the entire display signal.In other embodiments, processor 110 may transform only the portion ofthe display signal that corresponds to the location of the surfacefeatures 117. For example, in one embodiment, the display signal maycomprise data that corresponds to an image of a flower. In such anembodiment, display 116 may comprise a skin comprising surface features117 in the form of a QWERTY keyboard. In such an embodiment, theprocessor may transform the display signal to adjust the brightness,hue, saturation, contrast, sharpness, or image warping of the portionsof the display signal that the QWERTY keyboard will distort. Thistransformation may serve to minimize the distortion caused by thesurface features 117. In another embodiment, the display may comprise areflective surface, for example, a bench on a sidewalk. In such anembodiment, the display signal may correspond to an image of a flower.In such an embodiment, processor 110 may transform the display signal toadjust the brightness, hue, saturation, contrast, or sharpness on theportions of the display signal that the bench will distort. For example,the processor may transform the portions of the signal that aredisplayed on the bench's bolts and posts. Thus, when a projector outputsthe image, the bolts and posts may not significantly distort the flower.

In an embodiment wherein the display comprises a reflective surface, thereflective surface may further comprise surface features that are moreor less reflective than the rest of the surface. For example, in oneembodiment, the reflective surface may be a bench on a sidewalk. Thebench may comprise bolts that are very reflective, and posts that areless reflective. In such an embodiment, the processor 110 may determinethat the brightness of the display signal should be reduced in the areasthat correspond to the location of the bolts. The processor may furtherdetermine that the brightness of the display signal should be increasedat the areas that correspond to the location of the posts. In otherembodiments, the processor may further determine to increase or decreasethe contrast, hue, or sharpness of the portions of the display signalthat correspond to the location of surface features. In otherembodiments, the surface features on the surface of the display may havecharacteristics that further distort the displayed image, for example,the surface may be curved, or covered by a shadow. In such embodiments,the processor 110 may determine modifications to the display signal tocompensate for the distortion, for example, the processor 110 mayincrease or decrease contrast, hue, sharpness, brightness, resolution,image warping, saturation, or other signal characteristics. In otherembodiments, processor 110 may stretch, compress, or otherwise modifythe image itself.

In some embodiments, the surface features may move across the surface ofthe display. For example, in an embodiment wherein the display surfacecomprises a reflective surface, the reflective surface may shift in thewind. In such an embodiment, processor 110 may be configured tocompensate for the moving portions of the display. In anotherembodiment, the processor may transmit a signal to a haptic substratethat is configured to generate surface features on display 116. In suchan embodiment, the signal may be configured to cause the surfacefeatures to move across the surface of display 116. In such anembodiment, the processor may be configured modify characteristics ofthe video signal to compensate for the movement of the surface features.

Finally, processor 110 causes the display signal to be displayed 508. Insome embodiments, processor 110 may transmit the transformed displaysignal to a display. In some embodiments, the display may comprise anLCD display or a CRT display. In other embodiments, the display maycomprise a reflective surface, and the processor may output the displaysignal to a projector, which projects the display signal onto thereflective surface. In such an embodiment, the reflective surface maycomprise, for example, a floor, a wall, a sporting field, a bench, or aperson.

Illustrative System for Compensating for Distortion Caused by SurfaceFeatures on a Display

FIGS. 6 a and 6 b are illustrations of a system for compensating forvisual distortion caused by surface features on a display according toone embodiment of the present invention. The embodiments shown in FIGS.6 a and 6 b comprise a mobile device 600. The mobile device 600comprises a display 116. The display 116 further comprises an image of acountry road 620. The surface of display 116 further comprises surfacefeatures 117. In the embodiment shown in FIGS. 6 a and 6 b, surfacefeatures 117 form a grid pattern on the surface of display 116. In oneembodiment, grooves cut into the surface of display 116 may form surfacefeatures 117. In other embodiments, the user may place a skin comprisingsurface features 117 over the surface of display 116. In such anembodiment, the user may remove the skin and replace it with a new skincomprising different surface features. In still other embodiments, thesurface features may be dynamic surface features formed by a hapticsubstrate configured to receive a signal from processor 110, and inresponse generate a dynamic surface feature on display 116.

In the embodiment shown in FIG. 6 a, mobile device 600 has not activateda system or method for compensating for distortion caused by surfacefeatures on a display. Thus, the video signal is output without anytransformation to compensate for distortion caused by surface features117. As shown in FIG. 6 a, surface features 117 distort the image 620displayed by display 116.

The embodiment shown in FIG. 6 a utilizes a system for compensating fordistortion caused by surface features on a display. In the embodimentshown in FIG. 6 b, processor 110 received a display signal comprisinggraphical data. In some embodiments, the graphical data may comprisedata associated with a plurality of pixels. In the embodiment shown inFIGS. 6 a and 6 b, the plurality of pixels form the image 620. Further,processor 110 determined a location of the surface features 117 ondisplay 116. And based at least in part on the determination of thelocation of surface features 117, processor 110 transformed the pixelsof the display signal. For example, in the embodiment shown, processor 6b may have adjusted the brightness, contrast, hue, contrast, resolution,or sharpness of the pixels that are located in the areas of display 116corresponding to surface features 117. In other embodiments, processor110 may stretch, compress, or otherwise modify the image itself. Thenprocessor 110 caused the transformed display signal to be displayed. Asshown in FIG. 6 b, surface features 117 still cause some distortion ondisplay 116. However, the transformation reduced this distortion, thusallowing display 116 to display image 620 more clearly.

Advantages of Compensating for Distortion Caused by Surface Features ona Display

Embodiments of systems and methods for compensating for distortioncaused by surface features on a display provide various advantages overcurrent systems. A display that includes some form of surface featuremay provide the user with tactile feedback, which makes the device moreintuitive, accessible, and/or usable. However, the surface features maydistort the image on the display. If the device compensates for thisdistortion, then the image will appear clearer to the user. Thus, theuser will benefit from the advantages of surface features, withoutlosing the visual clarity found on a flat display surface. This willlead to user satisfaction and more widespread use of the device.

Embodiments of the present invention can be implemented in digitalelectronic circuitry, or in computer hardware, firmware, software, or incombinations of them. In one embodiment, a computer may comprise aprocessor or processors. The processor comprises a computer-readablemedium, such as a random access memory (RAM) coupled to the processor.The processor executes computer-executable program instructions storedin memory, such as executing one or more computer programs formessaging. Such processors may comprise a microprocessor, a digitalsignal processor (DSP), an application-specific integrated circuit(ASIC), field programmable gate arrays (FPGAs), and state machines. Suchprocessors may further comprise programmable electronic devices such asPLCs, programmable interrupt controllers (PICs), programmable logicdevices (PLDs), programmable read-only memories (PROMs), electronicallyprogrammable read-only memories (EPROMs or EEPROMs), or other similardevices.

Such processors may comprise or be in communication with media, forexample computer-readable media, that may store instructions that, whenexecuted by the processor, can cause the processor to perform the stepsdescribed herein as carried out or assisted by a processor. Embodimentsof computer-readable media may comprise, but are not limited to, anelectronic, optical, magnetic, or other storage or transmission devicecapable of providing a processor, such as the processor in a web server,with computer-readable instructions. Other examples of media comprise,but are not limited to, a floppy disk, CD-ROM, magnetic disk, memorychip, ROM, RAM, ASIC, configured processor, all optical media, allmagnetic tape or other magnetic media, or any other medium from which acomputer processor can read. Also, various other devices may includecomputer-readable media, such as a router, private or public network, orother transmission device. The processor and the processing describedmay be in one or more structures, and may be dispersed through one ormore structures. The processor may comprise code for carrying out one ormore of the methods (or parts of methods) described herein.

GENERAL

The foregoing description of the embodiments, including preferredembodiments, of the invention has been presented only for the purpose ofillustration and description and is not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Numerousmodifications and adaptations thereof will be apparent to those skilledin the art without departing from the spirit and scope of the invention.

That which is claimed is:
 1. A system, comprising: a display comprisinga touch-screen comprising a surface feature; and a processor coupled tothe touch-screen and the display, the processor configured to: receive adisplay signal associated with an image; receive a signal associatedwith the surface feature; transform the display signal based at least inpart on the surface feature; and transmit the transformed display signalto the display.
 2. The system of claim 1, wherein the touch-screencomprises a transparent surface.
 3. The system of claim 1, furthercomprising a substrate associated with the surface feature, and whereinthe processor is further configured to: transmit a deformation signalassociated with a deformation to the substrate, the substrate configuredto modify the surface feature based on the deformation signal.
 4. Thesystem of claim 3, further comprising: an optical sensor configured todetect optical information and transmit a user signal; wherein theprocessor is further configured to receive the user signal; and whereinthe deformation is associated with the user signal.
 5. The system ofclaim 4, wherein the deformation is configured to magnify the user'sview of the display.
 6. The system of claim 4, wherein the user signalcomprises data associated with one or more of a viewing angle or eyemovements.
 7. A method comprising: receiving a display signal associatedwith an image; receiving a signal associated with a surface feature on atouch-screen; transforming the display signal based at least in part onthe surface feature; and transmitting the transformed display signal toa display, wherein the display comprises the touch-screen.
 8. The methodof claim 7, wherein the touch-screen comprises a transparent surface. 9.The method of claim 7, further comprising: transmitting a deformationsignal associated with a deformation to a substrate associated with thesurface feature, the substrate configured to modify the surface featurebased on the deformation signal.
 10. The method of claim 9, furthercomprising: receiving a user signal from an optical sensor configured todetect information associated with a user and transmit a user signal;and wherein the surface feature is associated with the user signal. 11.The method of claim 10, wherein the deformation is configured to magnifythe user's view of the display.
 12. The method of claim 10, wherein theuser signal comprises data associated with one or more of the user'sviewing angle or the user's eye movements.
 13. A non-transitory computerreadable medium comprising program code, which, when executed by aprocessor, is configured to cause the processor to: receive a displaysignal associated with an image; receive a signal associated with asurface feature on a touch-screen; transform the display signal based atleast in part on the surface feature; and transmit the transformeddisplay signal to a display, wherein the display comprises thetouch-screen.
 14. The non-transitory computer readable medium of claim13, wherein the touch-screen comprises a transparent surface.
 15. Thenon-transitory computer readable medium of claim 13, further comprising:transmitting a deformation signal associated with a deformation to asubstrate associated with the surface feature, the substrate configuredto modify the surface feature based on the deformation signal.
 16. Thenon-transitory computer readable medium of claim 15, further comprising:receiving a user signal from an optical sensor configured to detectinformation associated with a user and transmit a user signal; andwherein the surface feature is associated with the user signal.
 17. Thenon-transitory computer readable medium of claim 16, wherein thedeformation is configured to magnify the user's view of the display. 18.The non-transitory computer readable medium of claim 16, wherein theuser signal comprises data associated with one or more of the user'sviewing angle or the user's eye movements.